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BACKGROUND OF THE INVENTION 



Field of the Invention 



The invention is generally related to audio and video recording and playback systems for 
aircraft and is specifically directed to a single, multifunction control unit for recording, 
transmission and playback of both audio and video signals. 



Recording systems have been used on board aircraft for many years. In the military, many 
aircraft such as, by way of example, the U.S. Navy F-14 Tomcat, have included recorders that 
permit the pilot to selectively record video images by activating the recorder. These systems also 
permit the images to be played back for viewing in a cockpit monitor by the pilot while in flight 
or, selectively, permit transmission of the images to a ship or ground station. The images are 
typically input from a video sensing device located in the aircraft and also controlled by the pilot. 

Over the last several years a need has developed for better image recording, capture, 
playback and transmission techniques on board these aircraft. The current systems, such as, by 
way of example, the TEAC VI 000 Video Tape Recorders (VTRs), only permit twenty minute or 
less recording capability and must be scrolled in order to find specific images in the recording. 
Further, if a specific image is to be displayed as a still frame on the cockpit monitor, the recorder 
is stopped and live images cannot be recorded by the video during this interruption. 

It is also desirable that the recording system be expanded to include cockpit audio, 
telemetry signals,GPS (Global Positioning System) signals and other data signals available for 
monitoring the performance of the aircraft and for increasing the amount of information associated 
with the video signals. 



Discussion of the Prior Art 
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SUMMARY OF THE INVENTION 

The multifunction remote control system of the subject invention is specifically directed 
to an enhanced video recording, transmission and playback system for aircraft. The system is 
capable of not only recording, transmitting and playing back video images but is also adapted for 
recording, transmitting and playing back audio, telemetry, GPS and other data signal in 
synchronization with the video signal. One important unique feature of the invention is the 
incorporation of a single, multifunction remote control unit for controlling all the recording, 
capture, transmission and playback functions at the fingertips of the pilot. 

The system of the subject invention utilizes a digital image capture system capable of 
operating as a recorder and playback unit as well as a transmission system for transmitting full 
motion, selected still frame and combined full motion and still frame video images to an on board 
monitor or to a ship or shore station. One of the important features of the invention is the 
capability to capture and transmit a still image on the fly while the recorder is still functioning. 
This is made possible by incorporating a digital image capture device that receives and captures 
the images being entered on the recording medium without interfering with the recording function. 
This also allows for better quality still images by permitting the capture and transmission of a full 
frame video image instead of the partial frame, single field still images of the prior art. 

In operation, the recorder may be paused in typical fashion in order to view a single frame. 
As with prior art systems, this will pause the recording function and the single still frame be a 
typical analog frame with a partial field image, often including the typical tearing which is a 
standard paused playback artifact. However, if the specific image is desired to be captured and 
transmitted, the operator (or pilot) will select the capture mode and the system will back up a 
preselected number of frames and then forward through the selected still in order to digitally 
capture the selected image as a full frame image. This eliminates the fuzzy quality of single field 
images and eliminates the tearing, as well, resulting in a more reliable, sharper image for 
monitoring on site or for transmission to a remote location. 

The system also permits on the fly capture of still frames without interrupting the recording 
cycle. In both the record and pause modes and the record and capture mode, the resulting captured 
signal is a sharp, full field (or full resolution) signal with a minimum of noise. 

Another important feature of the invention is the capability for "marking" the recorded 
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medium for later selecting, and capturing selected stills. During the recording mode, this marking 
function permits selection for later seek and capture either during later playback after completion 
of a mission, or during the mission directly in the cockpit, using the cockpit monitor. When the 
media is in the playback mode, the "marked" stills may be either automatically captured and stored 
5 and/or transmitted as full frame digital stills, or the system may be used to manually scroll through 
the recording one-by-one or automatically scroll through all of the selected, marked stills for 
sequential viewing/and or transmission. This capability is particularly useful for verification of 
visual data, such as, by way of example, the visual verification of a target by a ship or shore 
station. 

10 Another important feature of the invention is the automatic "reset" feature, where the 

beginning of each mission is marked on the recording medium and the counter point is noted or 
M reset to zero. This permits ready identification of the beginning and end of each mission and 
(a permits the operator or pilot to automatically return to the beginning of each mission to review the 
I ^ recorded images and data without searching for the start point. 

fUl5 The digital capture capability of the subject invention permits continuous real time 

C3 recording of video and other data while simultaneously permitting the pilot or other operator to 

£0 

?y select a "freeze" frame, permitting close analysis of a specific view without interrupting the 
^2 recording process. The recorder/playback systems of the prior art require interruption of the 
CO recording process during a freeze-frame or pause mode. One important aspect of this feature is 
20 the ability to not only view the select "freeze" frame, but also to capture, store and/or transmit the 
frame to a remote station. 

^Ji/VS A 1 j> The versatility of the system of the subject invention permits transmission of the full 
"'^motion imagbsboth in real time, or as a played back recording, as well as still frames of selected 
images and bursrmodes. The burst mode is a selection of sequential still images over a selected 
25 time frame. For example, assuming a target is identified and destroyed, it may be desirable to 
select a sequential series of still images at specific timed intervals, e.g. every one-fourth of a 
second, for five seconds before and twenty seconds after destruction, while at the same time 
simultaneously recording the mil image on tape without interruption. The burst mode is more 
fully described in my co-pending application entitled: Video and Data Capture and Retrieval 
30 Surveillance System for Aircraft, Serh*l No. 08/729,139, filed on October 1 1, 1996; Acoustic 



j\ I . Catastrophic Detection and Data Capture and Retrieval System for Aircraft; Serial No. 

08/738^487, filed on October 28, 19961 and Wireless Transducer Data Capture and Retrieval 
System foKAircraft, Serial No. 08/745,536, filed on November 12, 1996 and incorporated by 
reference here* 

5 One advantage of the system of the present invention is the capability for recording not 

only video signals but also cockpit audio and telemetry, GPS and other data signal as well, in a real 
time, synchronized relationship with the video image. The data signals are displayed in 
alphanumeric symbols with the video image in both the full motion and still frame mode. The 
audio portion is recorded for playback and transmission in the full motion mode. The data signals 
10 can be used as part of the marking function. For example, specific still frame images could be 
Q selected based on GPS data for capture and storage, as well as for transmission. 

One of the most significant advantages of the subject invention is the inclusion of all the 
functional and operating controls in a single remote control unit easily accessed by the pilot in the 
cockpit. This permits easy access and control of the system during flight, permitting full use of 
fUl5 the multifunction capability of the system. In the preferred embodiment, Phototelesis ATR- 
f3 403 WB and RCU-403 capture and transmission modules are combined with a TEAC HI 8 V80 
VTR recorder/playback unit. This can be activated during both the recording mode and the 

i %s 

SO playback mode. These components are combined and programmed with the novel features of the 

*B 

ffj subject invention to provide the versatile, multifunction system. The single, multifunction remote 
20 control unit is then utilized to not only control the recorder record and pause and playback function 
but also to control the select, capture and transmit functions of the processor. 

It is, therefore, an object and feature of the subject invention to provide for a versatile, 
accessible, multifunction recording and playback system for recording video images on board an 
aircraft during flight. 

25 It is also an object and feature of the subject invention to provide for a single, multifunction 

control unit for controlling all recording, selection and capturing, transmission and playback 
functions of the system. 

It is another object and feature of the subject invention to provide for a combination video, 
audio and data recorder having a single remote control unit for controlling all of the functions from 

30 a single control unit. 



It is yet another object and feature of the subject invention to provide for a multi-media 
recording, transmission and playback system which is capable of selecting, displaying, storing and 
transmitting still full field still frame images without interruption of the real time recording of full 
motion images. 

It is also an object and feature of the subject invention to permit marking of selected stills, 
bursts or sections of full motion image segments via operator controlled selection, or selection 
based on predefined criteria such as time sequencing, GPS data or other. 

Other objects and features of the invention will be readily apparent from the accompanying 
drawing and detailed description of the preferred embodiment. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an overview of some of the platform configurations for which the system of the 
subject invention is suited. 

Fig. 2 is a system interface diagram. 

Fig. 3 is a more detailed diagram of a system having the components as shown in Fig. 2. 
Fig. 4 is an alternative embodiment incorporating an MIL-ST-1553 data bus. 
Fig. 5 is an alternative embodiment incorporating a platform computer associated with the 
system of the subject invention. 

Fig. 6 is a block diagram of central processing unit of the system. 
Fig. 7 is a block diagram of the remote control unit of the system. 
Fig. 8 is an enlarged view of the remote control unit shown in Fig. 2. 
Fig. 9 is a menu flow chart for the system. 

Figs. 10a, 10b and 10c are an expanded menu readout display, showing the alphanumeric 
display for each of the menu selections of Fig. 9. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

A system overview is shown in Fig. 1 . The system is adapted for use in any type of 
platform permitting not only the recording, capture, transmission and playback of video 
information, but also the mating of data signals and audio signal with the video information. The 
platform used as an example throughout this disclosure is a fixed wing military aircraft 1, such as, 
by way of example, the Navy F-14 Tomcat. The multi-function system of the subject invention 
permits data to be used on board the aircraft, as well as transmission and receipt of data between 
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a remote station such as a ship or ground based station 2. Images and data can be downlinked 
directly to the base station and configuration and control data and signals uplinked to the aircraft 
via radio transmission. The system of the present invention also accommodates air-to-air 
transmissions, as between the fixed wing aircraft 1 and the rotary winged aircraft 3, or air-to-sea 
transmissions, as between the fixed wing aircraft 1 and the marine vessel 4, or to ground as with 
the fixed winged aircraft 1 and the military vehicle 5 or the civilian vehicle 6. Any of a variety 
of combinations is possible. While the following description is directed primarily to 
communication between fixed wing aircraft and a ship or ground based system, it should be 
understood that the invention encompasses any combination of base and object stations or units. 

As shown in Fig. 2, the system of the subject invention comprises a central processor unit 
10, a recorder/playback unit 12, a base or interface unit 14 and a multifunction, single remote 
control unit 16. In the preferred embodiment, the central processing unit 10 is a Phototelesis A72- 
403 WB and the remote control unit 16 is a Phototelesis RCU-403WB. The recorder/playback unit 
12 is a TEAC HI 8 V80 VTR system. The access door 18 provides access to the HI 8 V80 tape 
cassette which is capable of up to two full hours of real time recording. 

The remote control unit 16 is connected to the central processor 10 at connector J 10 via 
cable 20. Wireless remotes may also be incorporated in the system without departing from the 
scope and spirit of the invention. A 28VDC power signal is provided via a cable connection at the 
J2 connector in the interface unit 14. The monitor system 21 comprises the 22 Lanterin Control 
Panel (optional), the PTID display 24 and the VDI display 26. These are connected to the system 
via cable system 28 at connector J4 in the interface unit. An ICS/DATA signal is connected via 
connector J3. The TCS video module 29, the video source, is connected via connector J5. The 
28VDC power signal is transmitted from the interface unit 14 to the central processor 10 via a 
cable system 30 between connectors J7 and J 13. Communication and control signals are 
transmitted between the central processor and the interface unit via cables connected to connector 
J3 in the interface unit and connector Jl 1 and J12 in the processor unit. The main power switch 
is SW1 in the interface unit. The recorder/playback unit 12 is connected to the central processor 
via a cable system 30 between connectors Jl and J2 on the recorder playback unit, J15 on the 
Interface unit and connector J9 on the processing unit 10. A signal light LED 1 is provided on the 
central processor to indicate that the processor is powered and operational. 
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Once the system is powered up, all of the functions are controlled by the single remote 
control unit 16 which includes a plurality of function buttons 32 and an alphanumeric display 
panel 34. 

As shown in more detail in Fig. 3, the system of the subject invention is adapted for 
5 interfacing with a telemetry and GPS data, as indicated by the GPS receiver 40 and the aircraft 
interphone 42. In a standard application, the central processing unit can transmit and receive radio 
signals from a ship, ground or other aircraft radio via antenna 44, radio link 46 and, where desired, 
an encryption unit 48. 

lie video switching module 50 is housed in the interface unit 14. Switch A in the video 
10 switching n^odule 50 permits selection between any of a plurality of video sensors such as video 
"~ sensors A an^ B, as shown. These may be manually selected via the remote control unit 16, or 
\& programmed selection may be utilized as programmed at the central processing unit 10. A 

=S \ 
f \ 

id controller module, 52 receives the control and selection signal input on the data line 54 which is 

I u \ 

j>y an RS-232 data line\onnected to data port 4 of the central processing unit. The processor video 
! ^15 input select switch B\s also provided in the video switching module and is controlled by the 

C3 controller 52 and selects the sensor sources or the recorder/player output for 

CO 

ry capture/processing/storage/tfansmission. A display monitor input select switch C is also provided 

#« 

=i 
ti * 



for selecting either the recora^f/player unit output on line 56 or the processing unit output on line 
5*r 



20 As shown in Fig. 3, the data signals from the GPS receiver and other data signal are 

introduced into the processor 10 for conditioning and input for recording at the data/control port 
of the recorder/player 12 and permit for digital storage, and transmission. This permits the data 
signals to be recorded in simultaneous, real-time mode with the video signals input from the video 
sensors A and B. The audio signal from the interphone 42 is also input to the processor 10 and the 

25 recorder/player unit 1 2 for real time, synchronized recording. 

An optional high speed radio link 47, may also be provided to support full motion 
transmission capability and is linked to the high speed radio port of the processing unit 10 through 
the optional encryption unit 49. The antenna 45 permits downlinking to a base station via wireless 
radio. This high speed full motion capability could be incorporated in any of the various 

30 configurations of the invention. Compression of the video signal with a compressor algorithm 
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such as MPEG 1 is desirable. 

Alvalternative embodiment is shown in Fig. 4 and incorporates an MIL-STD-1553 data bus 
4(5r connecting the display 21, the GPS and/or other data signal modules 40 and the radio and data 
controller 48 to the system. The radio interphone system 60 is also expanded to include additional 
5 audio channels. A\VDU input matrix module 62 is provided for controlling the various video 
input signals to the cockpit integrated display 21. This is controlled by the platform controller 
computer 70 which is als^ connected to the display 21 and the processor unit 10 by the MIL-STD- 
1553 data bus. 

The 1553 bus is one common standard for interconnection of a plurality of data devices on 
10 military airborne or ground platforms. It is the equivalent of a local area network (or LAN). Other 

£3 

*g networking devices can be utilized without departing from the scope and spirit of the invention. 
f "Z Many different sensors and data signal generators may be connect to the 1553 bus, and data may 
|U be fused with imagery for recording, digital storage or transmission. Examples of sensors that may 

ru 

|jj be utilized in connection with the subject invention and communicate and interact of the 1553 bus 

* -15 are: GPS receivers, magnetic compass system, laser range finders, a time source, the aircraft 

£3 altimeter, and FLIR data, azimuth, range and location sensors. This greatly expands the versatility 

fy of the recording, capturing, transmission and playback capabilities of the system of the subject 

in 

invention. 

to Data received by the 1553 bus may be processed and stored digitally with the processing 

20 unit 10, or may be encoded and stored on the recorder/player unit 12, or both. This allows for the 
capture and retrieval of a wide variety of real time mission data in connection with the mission 
video signals. The control of the processing unit 10 and the recorder/player unit 12 can be 
accomplished from the integrated VDU/key unit and the platform control computer over the 1553 
bus. Digital data, such as video, audio, telemetry data, control commands, and the like may be 
25 communicated between the processing unit and the radio link (at 48) over the 1553 bus. In this 
manner, control commands can be transmitted from a remote station to the platform by using the 
common data link available to the platform. 

Another embodiment of the subject invention is shown if Fig. 5. In this embodiment, the 
various components and data entry devices correspond to those shown in Figs. 3 and 4. However, 
30 a platform computer 70 has been incorporated to illustrate the adaptability of the device to vehicles 
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having a conventional PC (personal computer) or a platform specific computer capability. In this 
configuration, the multifunction system of the subject invention may be controlled via the platform 
computer. Video is displayed on the computer VDU 72 by digitizing the video and merging it 
with the computer generated video in a display window. In addition, a window is provided for the 
commands of the system, replacing the remote control unit 16. The communication connection 
78 between the processing unit 10 and the platform computer 70 may be an RS-232 cable, a LAN 
connection such as Ethernet MM-STD-1553, or any other data communications link. Other 
platform data, such as data from other sensors and computers, can be linked into the system from 
a LAN 76 or other direct communication connections. The computer keyboard 74 permits direct 
command and data entry into the platform computer. A mouse input device or other similar input 
means could also be used. 

A block diagram of the basic components of the central processing unit 10 is shown in Fig. 
6. A remote 28VPC power source is connected as shown in Fig. 2 and as indicated at 100. This 
is introduced into a DC/DC converter 102 for powering the cooling fan 104 and providing system 
power at 106. When power is on, the pilot light LED 1 is illuminated. The heart of the processor 
10 is a Pentium class CPU 108, which is connected to a PCMCIA memory card 110, RAM 
memory 112 and ROM memory 1 14, as well as the BIOS system 1 1 6 via an address bus 118 and 
a data bus 120. The CPU 108 controls the PCMIA, RAM, ROM and BIOS components via the 
control bus 122. The various components controlled by the CPU 108 via the control bus for 
handling the flow of data and information on bus 124 are all interconnected via the bus 124, as 
shown. The audio interface 126 permits communication with an analog radio interface and the 
platform interphone system 42 (See Fig. 3). The synchronous communications interface 128 
provides the communications link between the CPU 108 and the digital encryption/radio interface 
48 (also Fig. 3). An option 1553 bus interface 130 for use with the configuration shown in Fig. 
4 is also provided. The RS-232 interface 132 provides communications links to the various RS- 
232 devices such as the GPS receiver 40, the remote control unit 16, the platform computer 70, 
the video switching module 50, and the like. The RS-422 interface 134 is the link between the 
CPU 108 and the recorder/player component 12, other interfaces may be used. An optional LAN 
interface is also provided for supporting, by way of example, a LAN interfaced platform computer 
70 as shown in Fig. 5. Video display logic is provided at 138 for supporting a CRT/VDU display 
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device 21 . The video frame capture device 140 supports the capture function directly from the 
video sources such as sensors A and B, thereby permitting video capture without interrupting the 
recorder 12. A "feature connector" interface allows full motion data between the Video Frame 
Capture input and the Video Display Logic. The optional MPEG compressor 142 provides the 
high speed interface for supporting full motion transmission via the high speed radio link 47 (see 



A block diagram of the remote control unit 16 is shown in Fig. 7, the remote control unit. 
Is also powered by the platform power supply with a 28VDC power signal as shown at 150. The 
power signal is introduced to the DC/DC converter 152 for providing system power at 14. The 
control signals from the system processor 10 are input and output on the RS-232 line 156 via the 
respective receiver 158 and driver 160. These signals are introduced into a microprocessor 162 
via the serial input/output port 164. The microprocessor system includes a FLASH-RAM 166, a 
RAM 168 and a ROM 170, in communication with the microprocessor 162 via data bus 172, 
address bus 174 and control bus 176. A data bus 178 links the parallel display bars LED 1 80 and 
LED 182 with the microprocessor, and also links the various control buttons 32 with the 
microprocessor. In the preferred embodiment, the control buttons 32 are the input device for the 
system. 

As better shown in Fig. 8 the control buttons 32 are dynamic function buttons located on 
the face of the remote control unit 16 in a row underneath the dual LED displays 180 and 182. 
The function of each button is dynamic, i.e., the function changes based on the stat of the system 
and the user interface. The specific function is shown in the LED row and is positioned directly 
above the button. This method permits maximum versatility with a minimum number of buttons 
(Six in the preferred embodiment). 

The versatility of the system is demonstrated by the menu commands utilized in the 
preferred embodiment, all accomplished with the six dynamic control buttons on the remote 
control unit 16: 



Fig. 3). 



RECORDER/PLAYER COMMANDS & SUMMARIES: 



Standby (STOP) 



Record 



Play 



Rewind 
Fast Forward 
Forward Search 
Reverse Search 
Unthread 
Reset Counter 
Event Mark 

RECORDER/PLAYER STATUS (MESSAGE) SUMMARY: 
Standby 
Recording 
Play 
Rewind 
Fast Forward 
Scan Forward 
Scan Reverse 
Unthread 

Counter (Hours:Minutes:Seconds) 
End of Tape (EOM) 
Beginning of Tape (BOT) 
Internal Error 
Command Error 
Communications Error 
Event Mark 
Dew (Condensation) 
IMAGE STORE/TRANSMISSION COMMAND SUMMARY: 
Send 

Send and Delete 
Set Send-to Call Sign 
Set Local Call Sign 
Capture 



* 



* 



-12- 

Capture & Send 

Set SNAP/BURST Mode 

Set Burst number 

Set Burst Interval 

Review Image Buffer 

Scroll Forward 

Scroll Reverse 

Mark Image 

Delete Image 

Purge Buffer 

Find Mark & Capture 

Find Mark Capture and Send 

Find All Marks & Capture 

Find All Marks Capture & Send 

Communications Abort 

Select Input "N" 

View Recorder 

View Input 

View Processor 

Select Compression 

Set Resolution 

Input Type (S-video 5 composite, other) 
IMAGE STORE/TRANSMISSION SUMMARY: 

Sending to "XXXXX" 
Receiving from "YYYYY" 
Communications Error 

A flow chart of the menu capability is shown in Fig. 9, initiating at Main Menu 200. Each 
of the selections 15 accessed by activating the various dynamic button switches 32 (See Figs. 2, 
3 and 8). As indicated by the flow chart, the menu is scrolled through with the display shown in 
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the parallel display bars LED 180 and LED 182 (Fig. 8). A more detailed menu/display 
correlation is shown in Figs. 10a, 10b and 10c. Beginning at the Top Level Menu 202, reflecting 
the recorder state, the top display 1 80 shows various counter functions and the bottom display 1 82 
illustrates the button function of the button switch 32 immediately below the display panel. As 
shown, the top level first position is the Record menu 204, the Play menu 206, the Standby menu 
208 and the Unthread menu 210. This same display regimen is followed for each of the other 
Menu Levels which are activated as indicated in the drawing. 

While certain features and embodiments of the invention have been described in detail 
herein it will be readily understood that the invention encompasses all of modifications, 
enhancements and improvements within the scope of the following claims. 



